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Detecting a watermark embedded in an information signal. 



The invention relates to a method of detecting a watermark embedded in 
an information signal, comprising a correlation stq> for correlating said signal and an applied 
watermark, and an evaluation step for evaluating the result of said correlation. The invention 
also relates to a method for carrying out said method. 

5 

Watermarks are perceptually invisible messages embedded in multimedia 
content such as audio, still images, animations or video. They comprise information, for 
example, about the source or copy right status of documents or audiovisual programs. 
Watermarks can be used to provide legal proof of the owner of the copyright. They allow 

10 tracing of piracy and support the protection of intellectual property. 

A known method of detecting a watermark embedded in an information 
signal comprises a correlation step for correlating said signal and an appUed watermark. The 
result of said correlation is then evaluated. For example, if the amount of correlation is 
larger than a predetermined value, the applied watermark may be considered to be the 

15 watermark embedded in the signal. Alternatively, a number of successive correlation steps 
can be carried out for differem applied watermarks. The applied watermark yielding the 
largest correlation is Uien considered to be the watermark embedded in the signal. 

OBJECT AND SUMMARY OF THE INVENTION 
20 It is an object of the invention, inter alia, to provide a method with which 

an embedded watermark can yet more reUably be detected. 

To that end, the method is characterized by die steps of predictive 

filtering the infonnation signal or the applied watermark or both, and applying the 

correlation step to said filtered signal and said filtered watermark. 
25 The invention is based on the recognition tiiat the problem of detecting 

watermarks closely resembles the detection of weak radio or radar signals in the presence of 

strong interference or noise. By predictive filtering, i.e. subtracting a prediction of the 

information signal from said signal, a residual signal is obtained having a significant lower 
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variance. This means that the interference which the watermark suffers from the residual 
information is considerably less than it suffers from the original signal. 

These and other aspects of the invention will be apparent from and 
elucidated with reference to the embodiments described hereinafter. 

Fig.l shows schematically an arrangement for watermarking a video 

signal. 

Fig. 2 shows schematically a prior art arrangement for detecting a 
watermark embedded in the signal which is generated by the arrangement shown in Fig.l. 

Figs. 3 and 4 show schematically arrangements for detecting the water- 
mark in accordance with the invention. 

The invention will herein be described by way of an example of detecting 
a watermark which is embedded in a digital video signal. The watermarks can be added in 
almost every domain such as, for example, the time domain, the spatial domain, the 
transform domain after DCT or Fourier transform, etc. In the present example, it is 
embedded in the spatial domain, i.e. it is added to the luminance pixel values of a digital 
video signal. 

Fig.l shows schematically an arrangement 1 for watermarking the video 
signal. The arrangement receives a video signal in the form of luminance samples or pixels 
p(n) and a watermark Wj. The watermark can be a code which uniquely identifies the owner 
of the copyright. It can also be a text string or simply a binary coded number. Accordingly, 
there is a finite set of different watermarks W-. The arrangement comprises a watermark data 
signal generator 11 which generates a predetermined watermark data signal w-(n) for each 
watermark The luminance value p(n) and watermark data value w-(n) are added by an 
adder 12 pixel-by-pixel. Accordingly, the output signal Xj(n) of the watermarking circuit 1 is: 

(n) = p(n) (n) 

The watermark data signal Wi(n) is chosen such that it is perceptually 
invisible when the output signal is displayed on a receiver. For example, a small value is 
added to the luminance of .selected pixels p(n) of the video image, the watermark Wj 
determining the selected pixels. An example hereof will now be given in terms of an image 
of 8 pixels horizontally and 4 pixels vertically. It is to be noted that the method can also be 
applied to a predetermined part of the image. The method can also be applied to a plurality 
of image blocks, each block being associated with a portion of the watermark. 

CONFIRMATION COPY 
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in the present example, the value 1 is added to the luminance of selected 
pixels whereas other pixels remain unaffected. The foUowing equation denotes a watermark 
data signal w.(n) that is generated by watermark data signal generator 11 in response to a 
first watermark W,: 

01010101 
_10101010 
^'i^''^ " 0 1 0 1 0 1 0 1 
10101010 



nie following equauon denotes a watermark data signal w,(n) that is generated by the 
watermark data signal generator if a second watermark W, is appUed: 



15 



00110011 
11001100 
'^'2^''^ " 0 0 1 1 0 0 1 1 
11001100 



1„ Uus manner. 0,e watennarlc data signal g=ncrau,r U generals a different waBrmark da« 

10 signal Wi(n) for each watermark Wj. 

in the present example, the video image is assumed to represent a verucal 
transition from a luminance value 10 to a luminance value 80. The range of luminance values 
p(n) is assumed to be 0-255. In mathemaUcal notation: 

10 10 10 10 80 80 80 80 

10 10 10 10 80 80 80 80 

■P^"^ " 10 10 10 10 80 80 80 80 

10 10 10 10 80 80 80 80 



Accordingly, if watermark W. is appUed to arrangement 1, the watermark 
data signal w.(n) is added to image signal p(n), which results in the foUowing output signal 
x,(n): 

10 11 10 11 80 81 80 81 

11 10 11 10 81 80 81 80 
■^1^"^ * 10 11 10 11 80 81 80 81 

11 10 11 10 81 80 81 80 
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Similarly, if watermark is applied to the watermarking arrangement, the watermark data 
signal W2(n) is added to image signal p(n), which results in the following output signal X2(n): 

10 10 11 11 80 80 81 81 

11 11 10 10 81 81 80 80 
" 10 10 11 11 80 80 81 81 

11 11 10 10 81 81 80 80 

It will be appreciated that neither the difference between an output signal Xi(n) and input 
5 signal p(n), nor the difference between output signals Xi(n) and XjCn), is perceivable for a 
human visual system. The output signal Xi(n) is stored on a storage medium such as an 
optical disc or a magnetic tape, or transmitted through a transmission channel (not shown in 
Fig.l). 

Fig. 2 shows schematically a prior art arrangement 2 for detecting the 
10 watermark Wj embedded in the signal Xi(n). The arrangement receives a watermark Wj and 
delivers an indication of whether or not the applied watermark Wj resembles the embedded 
watermark Wj, i.e. whether i=j or not. The arrangement comprises a watermark data signal 
generator 21 which is identical to, and produces the same watermark data signal Wj(n) as the 
watermark data signal generator 11 which is shown in Fig.l. The input signal Xi(n) and the 
15 watermark data signal Wj(n) arc applied to a circuit which is often referred to as a matched 
filter or correlator. In the embodiment shown in Fig. 2, said correlator comprises a multiplier 

22 and a summation circuit 23. The correlator performs the following mathematical 
operation: 

C(i,j) = Xj. (n) ^Wj in) 
ji-i 

20 in which N denotes the total number of pixels. It will be appreciated that, if the information 
signal is an analog signal, for example a time continuous signal x(t), the summation circuit 

23 will be an integrator. 

The correlator output is a number C(i,j) which represents an amount of 
correlation between the input signal Xi(n) and the watermark data signal Wj(n). In an 
25 evaluation circuit 24, the value C(i J) is evaluated for various watermarks Wj. The watermark 
Wj yielding the highest correlation is then assumed to be the watermark Wj. Only two 
different watermarks are considered here. 
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10 



15 



20 



25 



30 



The correlation C(i J) can easily be calculated. If watermark W, is 
embedded in the signal, the correlation between x,(n) and w,(n) appears to be C(l,l)=736 
whereas the correlation between x,(n) and WjCn) appears to be C(l,2)=728. Because C(l,l) 
is greater than C(l,2), the evaluation circuit 24 determines that the embedded watermark is 
W,. If watermark is embedded, the correlation between Xjin) and w,(n) appears to be 
C(2,l)=728 whereas the correlation between X2(n) and Wj(n) appears to be C(2,2)=736. 
Because C(2,2) is greater than C(2,l), the evaluation circuit 24 determines that the embedded 
watermark is Wj. The following Table I summarizes the above results. The rows of this 
Table denote input signal x/n), i.e. the input signal in which a watermark Wj is embedded. 
The columns denote watermark Wj which is applied to arrangement 2. 





w, 




x,(n) 


C(l,l)=736 


C(l,2)=728 


X2(n) 


C(2,l)=728 


C(2,2)=736 



It will be appreciated from this example that the values of C(ij) 
representing the amounts of correlation are close to each other. This means that the detection 
circuit is vulnerable with respect to noise, transmission errors, coding errors, etc. 

Fig. 3 shows schematically an arrangement 3 for detecting the watermark 
Wj embedded in the signal x^Cn) in accordance with the invention. The arrangement 
comprises the same watermark data signal generator 21, multiplier 22, summation circuit 23 
and evaluation circuit 24 as are shown in Fig. 2. The arrangement further comprises a first 
predictive filter 25 and a second predictive filter 26. The first predictive filter 25 is 
connected between the signal input and the multiplier 22. It filters the input signal Xi(n) and 
generates a filtered input signal Xi'(n). The pre filtering process is also called "whitening", 
similar to filters that decorrelate noise in radar and radio communication receivers. 

The second predictive filter 26 is connected between the watermark data 
signal generator 21 and the multiplier 22. It filters the locally applied watermark data signal 
w^(n) and generates a filtered watermark data signal Wj*(n). The structure of each predicdve 
filter is based on statistical properties of the information signal. Such filters are known per se 
in the field of source coding. Examples are linear predictive fillers as used in DPCM image 
and speech coding. Other examples are combinations of a transform, a prediction for each 
frequency subband or transform coefficient, and an inverse transform. 
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In the present example, in which the input signal is a digital video image, 
predictive filter 25 predicts each pixel from its neighbours to the left, to the right, above and 
below. The predicted value is then subtracted from the actual pixel value to obtain a residual 
value. In mathematical notation: 

4 

in which u en v denote discrete pixel positions along the horizontal (u) and vertical (v) axes, 
y(u,v) denotes filter input samples and y'(u,v) denotes filter ou^ut samples. Accordingly, the 
following equations apply to the filtered input signal X|*(n) and the filtered input signal 
XjXn), respectively (a scaling factor 4 has been applied to maintain integer values): 



18 


14 
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-56 


147 


84 


77 


164 


14 


-4 
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-7 4 


74 


-4 
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77 
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4 


-4 


-66 


66 


4 


-4 


84 


24 


7 


14 


-6 3 


154 


77 


84 


158 



19 8 13 

^^^"^ = 8-33 
23 13 8 



-57 148 78 83 163 

-73 73 3 -3 78 

-67 67 -3 3 83 

-62 153 83 78 159 



Further, the first predictive filter 25 and the second predictive filter 26 are 
the same in this example. Although this is a preferred embodiment which yields the best 
performance, it is not essential. The filters may be different, or one of the predictive filters 
15 25 and 26 may even be dispensed with. The performance of the watermark detecting 

arrangement is then still significantly better than the perfomance of the prior art arrangement. 
Accordingly, the following equations apply to the filtered watermark data signal W|'(n) and 
the filtered watermark data signal w^Xn), respectively: 

-2 4 -3 4 -3 4 -3 4 

4 -4 4 -4 4 -4 4 -3 

in) * 

1 ' -3 4 -4 4 -4 4 -4 4 

4 -3 4 -3 4 -3 4 -2 
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-1-2 3 3-2-2 3 3 

3 3-3-3 3 3-3-2 

-2-3 3 3-3-3 3 3 

3 3-2-2 3 3-2-1 



The movAng Table H shows the amounts of correlation C(i J) between filtered input signal 
x,'(n) and filtered watermark data signal w;(n) corresponding with watermark W,. It will be 
appreciated from comparison with Table I that the performance of the watermark detector 
5. shown in Fig.3 is significantly better than the one shown in Fig.2. 



10 



15 



x,'(n) 



x,*(n) 



C(l,l) = 1152 



C(2,l)=704 



Table 11 



C(l,2)=704 



C(2,2)=952 



Table m shows the amounts of correlation between fUtered input signal 
x.'(n) and the unfUtered watermark data signal w.Cn), i.e. if the input signal x,(n) is subjected 
to predicuve fUtering only. The watermark data signal w,(n) is direcUy applied to the 
multiplier 22 in this case. As can be seen, the performance is worse than in Table II but still 





Wi 




x,'(n) 


C(l.l)=604 


C(l,2)=544 


x,'(n) 


C(2,l)=544 


C(2,2)=588 




table ill 



20 



Table IV shows the amounts of correlation between the unfiltered input 
signal x.(n) and the filtered watermark data signal w/(n). i.e. if the watermark data signal 
w.(n) is'subjected to predictive fUtering only. The input signal x.(n) is direcUy appUed to the 
multiplier 22 in this case. Again, the performance is worse than in Table U but still better 
than in Table I. 
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w, 




x,(n) 


C(l,l)=604 


C(l,2)=544 


xj(n) 


C(2,l)=544 


C(2.2)=588 



5 Fig. 4 shows a further embodiment of an arrangement 4 for detecting the 

embedded watermark. In this arrangement, each pixel of the input signal x^(n) is multiplied in 
a multiplier 42 by a specific weighting factor. The products are summed up in a summation 
circuit 43 which deUvers the correlation value C(ij). A calculating circuit 44 receives the 
applied watermark Wj and generates the weighting factors using a model of the statistical 

10 properties of the information signal. In this embodiment, predictive filtering is not applied to 
the input signal but embedded in the calculation circuit 44. 

In summary, a watermark embedded in an information signal is delected 
by correlating said information signal with a plurality of watermarks Wj(n). The respective 
amounts of correlation C(iJ) are then evaluated to determine the watermark embedded in the 

15 signal Xi(n), The invention provides a significant improvement of the detection by predictive 
filtering (25) the information signal and/or predictive filtering (26) the j^plied watermark 
prior to the process of correlating the signals. 
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Claims 



1 A method of detecting a watermark embedded in an information signal, 

comprising a correlation step for correlating said signal and an appUed watermark, and an 
evaluation step for evaluating the result of said correlation, characterized by the steps of 
predictive filtering the information signal or the appUed watermark or both, and applying the 
5 correlation step to said fUtered signal and said filtered watermark. 

2, The method as claimed in claim 1, wherein the predictive filtering is 

adapted to predetermined statistical properties of the information signal. 

3 The method as claimed in claim 1, wherein both predicuve filter steps are 

the same. 

IQ 4 A method of detecting a watermark embedded in an information signal, 

comprising the step of filtering said signal using filter coefficients determined by an appUed 
watermark, and evaluating the result of said filtering, characterized in that the filter 
coefficients are ftirther determined by a model of the statistical properties of the information 
signal. 

15 5 An arrangement for detecting a watermark (W,) embedded in an 

information signal, comprising correlation means (22.23) for correlating said signal (xj and 
an appUed watermark (W^, and evaluation mdms (24) for evaluating tiie result of said 
correlation, characterized by a predictive filter (25) for filtering the information signal or a 
predictive filter (26) to filter the applied watermark, or both predictive filters, and applying 

20 filtered signal and tiie filtered watermark to the correlation means. 

6. The arrangement as claimed in claim 4. wherein the predictive filters 
(25.26) are adapted to predetermined statistical properties of ihe information signal. 

7. ' . The arrangement as claimed in claim 5, wherein both predictive filters 

(25,26) are the same. 

25 8. An arrangement for detecting a watermark (W^) embedded in an 

information signal Q. comprising a filter (41.42.43) for filtering said signal using filter 
coefficients, calculation means (44) for calculating said filter coefficients in dependence on 
an appUed watermark (W,). and means (24) for evaluating Uie result of said filtering. 
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characterized in that the calculation means (44) are adapted to further determine the filter 
coefficients in accordance with a model of the statistical properties of the information signal. 
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